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I. Introduction 

The following report is an evaluation of the 1979-80 High School 
Title I English as a Second Language Program. Two types of information 
are presented: (1) a narrative description of the program which pro- 
vides qualitative data regarding the program, and (2) a statistical 
analysis of test results which consists of qualitative, city-wide data. 
By integrating both types of findings, the report offers an in-depth 
profile of the program and its educational significance. 

The narrative description includes a separate perspective on the 
effectiveness of the program from the point of view of the personnel 
involved in the program. The description is based on consultant obser- 
vations and interviews of program personnel in a selected number of 
exemplary and/or representative schools. They were chosen from a cross- 
section of schools based on last year's test results and the advice of 
the program coordinator. The narrative description addresses issues of 
staffing, program coordination, student characteristics and the instruc- 
tional program. 

The statistical information drawn from the program's criterion- 
referenced test specifies number of skills mastered, rate of success in 
meeting the evaluation objective, degree of participation and results 
according to instructional level. Attendance, reason for incomplete 
data, receipt of counseling and rate of success are analyzed. 

Finally, conclusions and recommendations are presented, based on 
the descriptive and statistical sections. 



- 2 - 



II. Narrative Description 

The High School Title I program for teaching English as a Second 
Language (ESL) has two long-range objectives: to enable foreign-language 
speaking students to acquire skills in speaking, reading, and writing 
standard English; and to enable these students to acquire and improve 
skills in reading and writing their native languages. In addition, the 
program has two short-term objectives: to promote the pupil's intellectual 
and emotional adjustment to a new school and cultural environment; and 
to reduce the drop-out rate among non-English speaking pupils by giving 
them a sustained feel Ing of belonging, accomplishment, responsibility, 
and success. To meet these ends, the program provides intensive small- 
class instruction in English as a Second Language. The Title I program 
operates at thirty-eight sites and serves approximately 7,000 students. 

Classes are officially limited to between fifteen and twenty stu- 
dents under the direction of one teacher and one paraprofessional educa- 
tional assistant. Some ESL classes, however, contain a larger nunber of 
students because foreign students are accepted into the program as they 
come into the school throughout the year. The basic program structure 
consists of three levels: beginning, intermediate, and advanced. 
FollowiJig instruction at the advanced level, students are placed into 
transitional classes which complete the ESL program. Each of these 
classes supplements the students' one class period of tax-levy English. 

• • Instruction in English skills is divided into phonology, voca- 

bulary, and sentence structure. These skills are presented sequen- 
tially; that is, the order of instruction is understanding, speaking, 
reading, and writing. There is more concentration on reading and 
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writing practice at the advanced or transitional level than at the 
beginning or intermediate levels, although work on all four modes of 
instruction occurs at all levels. 

Initial instruction in reading and writing is undertaken through 
the oral and visual presentation of materials. Thus, if the objective 
of a lesson Is the comparative fom of expression In English, the teacher 
begins with visual aids or examples from a familiar context to establish 
and Illustrate the concept. In two classes that were observed in this 
unit, teachers had sets of stick-figure illustrations which elicited the 
comparative form of expression. At first, students listened while the 
teacher described the pictures: "This man Is. taller than that man." 
After several examples, the students were asked to reproduce this 
syntactical structure. The mode of Instruction was repeated using 
comparatives with new vocabulary, negative statements, and questions. 
Following this, students were expected to offer original examples and to 
do written work with the comparative form. At an advanced level, the 
use of visual materials Is replaced with more sophisticated written or 
spoken instruction. For example, in a transitional class students were 
asked to prepare persuasive speeches or to debate the pros and cons of 
an issue. This elicited the use of the comparative form in a creative, 
t meaningful, and thought-provoking manner. 

In general. Instructional methods and activities Include oral 
practice drills, visual reinforcement, and concentrated review of 
grammatical structure and vocabulary. Writing skills are taught to all 
pupils according to progress made In speaking, listening, and reading. 
Various forms of dictation and Independent writing practice are pre- 
rn?^- sented from simple sentences to complex paragraphs or from highly 
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structured exercises to free exposition. 

The native Language Arts (NLA) or Language Experience Literacy 
(LEL) component of the program addresses the second long-range objective 
of the program: to enable students to study their own native language. 
This part of the program is necessary for students who have serious 
reading and writing problems in their native languages and cannot, 
therefore, participate effectively in high school classes in any language. 
All students enrolled in LEL classes receive concurrent English-language 
instruction through ESL classes. The program coordinators, aware of 
recent research, expect that strengthening students' native language 
literacy will facilitate their acquisition of English-language skills. 

In addition to the regular ESL format, th« program also has a Music 
Language Arts (MLA) component which provides additional motivation for 
language learning through the use of song sheets, records, and tapes 
especially designed for ESL. Music language arts instruction is con- 
ducted by ESL teachers with the help of workshops and materials offered 
by teacher trainers. At one high school a particularly talented teacher, 
trained in both ESL and music, conducted a highly successful MLA class. 
Students engaged in drills in which new language patterns were internalized 
through songs. Ttiis learning experience took place in a particularly 
enjoyable and lively atmosphere. 

The careful selection of program materials and the systematic 
instruction of new skills enable the program to address its long-run 
objectives. By meeting these goals the program also helps the students 
adjust to their new schools and new cultural environment. 
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Staff 

The program is administered throughout the participating high 
schools by a director who is responsible for the overall organization 
and site-by-site supervision of the program. Seven teacher trainers 
with experience and expertise in English as a Second Language and 
bilingual instruction conduct regular visits to the high schools and are 
responsible for providing on-site training and assistance to teachers 
and educational assistants. They offer help in improving teaching 
methods, choosing instructional materials, testing, and collecting data 
on student performance. Their activities include presenting workshops, 
developing and collecting materials for curriculum manuals, preparing 
the semi-annual ESL/LEL/MLA Newsletter , and conferring with school 
personnel concerning problems of programming and staffing. 

In most schools, an assistant principal or a special coordinator 
administers the ESL program and also serves as a liaison between school 
staff and the central office. The specific organization of the program 
in a school depends upon the needs of the student population and the 
discretion of the principal. In many schools where a large proportion 
of ESL students also participates in the bilingual program, ESL is a 
component of the bilingual department and under the direction of an 
assistant principal or the bilingual coordinator. In other schools, ESL 
falls under the aegis of the foreign language department and is directed 
by its department chairperson. In still other schools, ESL comes under 
the jurisdiction of English, speech or communication programs and is 
administered by one of these departments. 
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The assistant principal or program coordinator conducts regular 
meetings of ESL teachers at which problems can be discussed and ideas 
and materials shared. He/she is also responsible for seeing that 
progron guidelines are met and encouraging cooperation between Title I 
and tax-levy classes. At one school, in addition to the bilingual and 
ESL coordinators, there is a Title I coordinator responsible for facili- 
tating the operation of all Title I programs. In ESL programs that have 
more than three teaching positions, the coordinator may be relieved of 
one or more teaching periods, but in smaller programs, the coordinators 
carry out their responsibilities in addition to a full teaching load. 

Teachers confer with the program coordinator on the selection of 
tests, meet with teacher trainers, and screen students. ESL teachers 
must be trained in ESL theory and methodology and licensed by the New 
York City Board of Education/ State Education Department. The test for 
licensing New York City high school ESL teachers examines competency in 
applied and theoretical linguistics, in comparative analysis of syntactic, 
semantic and phonological structures, in teaching methods, and in text- 
book analysis and cross-cultural topics. 

The paraprofessional educational assistants v*io work with teachers 
in the classroom are frequently drawn from the immediate community. 
Generally they are not licensed ESL teachers, but through their class- 
room responsibilities they learn ESL techniques and objectives. Many 
are in training to be ESL or bilingual teachers and may consider their 
present positions as apprenticeships. They perfom such duties as 
correcting students' written work, giving special help to individual 
students, and assisting with clerical duties (filling out class records. 
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checking attendance, organizing and duplicating worksheets). At some 
schools, the ESL coordinator conducts workshops twice monthly at which 
paraprofessionals discuss such matters as lesson plans, types of lan- 
guage drill, and any problems or issues that need clarification. In 
smaller programs, where there is no organized workshop, the teacher 
meets daily with the paraprofessional to review lesson plans and home- 
work assignments, to discuss teaching techniques, and to prepare materials, 

Curriculum Materials - Instructional Approach 

Each teacher in the program is provided with a course manual the 
HRFST Objective Locator (COL) for beginning, intermediate and advanced 
level classes. The COL, following a standard list of textbooks and 
workbooks, is intended to guide instruction in areas covered by the 
Criterion Referenced English Syntax Test (CREST). The textbooks on this 
list include: Learning ESL by Oscar White and Sonja Martin; Graded 
Exercises in English by Robert Dixon; Access to En glish, I and II by 
Robert Breckenridge; and Revised Lado, Books 1-4 by Robert Lado. 

ThP CREST Objective Locator is a syllabus in which English skills 
are presented in increasing order of difficulty while previous skills 
are reviewed, reinforced and broadened. For example, the comparative 
form introduced at the intermediate level (Adam is as talj. as Mel vin) 
reappears at the advanced level . But with the addition of the concept 
of comparative nouns (Adam is the same height as Mel vin). 

A wide variety of books and supplementary materials are also 
available besides the basic texts. In addition, teachers share indi- 
vidually prepared worksheets to complement the lessons. Teacher trainers 
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on their visits to schools, often collect innovative materials from 
individual teachers and distribute them to other schools. Teachers are 
also invited to write articles for the ESL Newsletter discussing their 
materials, techniques, and innovations. Hence, although the COL lists 
specific items to be covered, teachers have ample opportunity to develop 
and implement their own pedagogical ideas. Besides curriculum variations, 
program flexibility is also apparent in course innovation. At one school, 
for example, a course in ESL Business Communication is being offered. 
This course includes exercises on writing business-letters, resumes and 
preparing for job interviews. 

The CREST is given at the beginning and at the end of each term to 
measure the students' progress in relation to instructional objectives. 
This test, developed as an alternative to standardized tests geared to 
English-speaking, students, helps to identify the specific skills mas- 
tered, or still needing mastery, by non-English speaking students. For 
every class, a CREST Class Record is kept, indicating school, teacher, 
ESL class title, date, level, and infonnation on each student, including 
his/her name, data control number, and test performance. All of the 
instructional objectives are listed and teachers indicate those which 
have been mastered by each student. Teachers reported that they use 
different symbols on the records in order to make pre- and posttest 
performance clear and to have a ready reference to the individual 
student's progress for the term. Since all the students are listed on 
one page, it is easy to compare students and to determine how the class 
as a whole perfonned. An investigation is needed of the extent to which 
the CREST test is used as a classroom instrument in monitoring the 
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progress of individual students, especially because of the supposed dual 
function of the test; that is, as both a curriculum organizer and an 
evaluative instrument. Given that approximately 1,200 student test 
results were not reported each term (see the next section) the actual 
classroom use of the test is particularly pertinent. 

Although the CREST results are a major determinant of a student's 
readiness to proceed to the next level of the program, they are not the 
only consideration. Quizzes, tests, homework assignments, and class 
participation throughout the term are also examined before a final 
recommendation is made. 

Ideally, the Title I and tax-levy classes are closely coordinated, 
and where this is achieved the result is very good. For example, after 
two periods of a Title I class devoted to sentence structure, students 
can proceed to a tax-levy English class whose teacher is aware of what 
has been done during the Title I periods and therefore is able to rein- 
force and enrich the students' understanding by presenting complementary 
reading or writing exercises. 

In general, coordination of Title I ESL and tax-levy classes at 
most sites is efficient with one period of tax-levy English to comple- 
ment two periods of ESL at the beginning and intermediate levels and one 
period of ESL at the advanced levels. Generally, the Title I classes 
tend to focus on syntax and phonology while the tax-levy classes are 
oriented mor:e towards reading and writing activities, although there is 
a good deal of overlap. 
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students 

Students in the New York City ESL programs come from ninety-one 
countries in which forty- three different languages are spoken. During 
the past school year, there were approximately 150.000 students in need 
of English as a Second Language--95,Q00 at the elementary level. 25.000 
on the junior high school level and 30.000 at the high school and vocational 
high school levels. Some of these students are in tax-levy ESL programs; 
others are not enrolled in the program because they are not Title I 
eligible. The majority of these students are of Hispanic background, 
but other language groups are heavily represented in some schools—at 
one high school, for example, there is a large Haitian-Creole speaking 
population, and at another, there is a concentration of Chinese students. 

Newly-arrived students are screened by ESL personnel in the school 
who place the students in appropriate classes. The level at which a 
student enters the program is determined by a placement examination and 
an interview. When possible, they are. also given informal tests in 
their native language and placed in Native Language Arts (ESL) classes 
if necessary. If a student progr^esses at an extraordinarily rapid pace 
or if initial placement was inappropriate, the class assignment may be 
changed. At one school . provision fpr different rates of progress is 
made through a tracking system consisting of an academic track for ■ 
faster students and a general track for others. In the academic track, 
the transitional class may be skipped by students who have mastered the 
objectives of the advanced level test. 

Some ESL classes have more than twenty students because foreign 
students are accepted into the program as they come into the country 
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throughout the year. At one school , for example, one class grew to 
forty-five students during the year. The teacher said that her educa- 
tional assistant alleviated the problem greatly by working individually 
with students who needed extra help. And the class at the time of 
observation ran very smoothly. But the disadvantages of an over-sized 
class should not be ignored. 

III. Discussion of Student Outcome Data 

Students participating in the English as a Second Language program 
were tested with the Criterion-Referenced English Syntax Test. Data 
were reported for 7,017 students in the fall and 6,274 students in the 
spring (see Tables 1 and 2 ). The evaluation objective of the program 
states that students should master two skills on the test for every four 
weeks in the program. Since classes were held for sixty-three days each 
term, a full-year participant should have mastered six skills each tem. 
Approximately one- fourth of the students met the evaluation objective 
each term (see Tables 1 and 2 ). 

No results were reported for approximately 1,200 students in both 
the fall and the spring. In Table 1 the statistical summary of the fall 
term includes these students in the totals, but excludes them frcm the 
results broken down by level. Because the test information was compiled 
differently in the spring, the spring results include these students in 
the level breakdowns throughout the summary. 

A large proportion of the students in the program were in the ninth 
and tenth grades. Of these students, most ninth graders were in begin- 
ning level classes. In the fall most tenth graders were in the inter- 
mediate level; in the spring many tenth graders shifted to the advanced 
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level. The few eleventh and twelfth graders in the program were mainly 
in the advanced classes. 

The proportion of students who met the objectives and the average 
nunber of skills they mastered decrease from the beginning to the ad- 
vanced levels. This decline is especially significant between the 
intermediate and advanced levels. The differences are to a great extent 
the result of the number of skills being tested an each level; the- 
beginning and intermediate level tests contain twenty-five objectives; 
the advanced level contains only fifteen. A little over half the skills 
attempted were eventually mastered. Clearly, if there were a higher 
proportion of skills mastered more students would have met the eval- 
uation objective. The average student--attending approximately sixty 
days and attempting six skills— should have mastered all six skills 
attempted in order to meet the evaluation objective of one skill for 
every ten days of instruction. On the advanced level of the test with 
only fifteen skills being tested, students failed to master an average 
of only five skills on the pretest. Even if they eventually mastered 
all the- skills in which they had demonstrated deficiency, they would 
still not have met the objective of the program. Thus, the small nunber 
-of skills mastered is mostly the result of the small number of skills on 
the test. 

. A small nunber" of students received counseling. This supportive 
service was fairly evenly distributed throughout the levels. The 
average attendance reported was very high and quite unifonn throughout 
the program. Students were absent on the average for only three days 
per term. 
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According to Tables 3 and 4 , the rate of mastery generally increases 
with more time in the program. Students for which no skills were re- 
ported are distributed throughout all the categories of attendance. 
These data indicate that the students were not simply "no shows", whose 
names were retained on the register during the course of each tenn. 
Indeed, one- third of all students who were not reported to have at- 
tempted any skills were present at least fifty-one days in either term. 

In Table 5 student attendance is broken down by complete data 
reported and reasons for incomplete data. All the records with incom- 
plete data contained no test results. Most of the reasons given were 
"absent for the test", "truant", and "discharged". Obviously, many of 
those identified as truant attended for only a few days. On the other 
hand, a majority of the students who were absent for the test had been 
attending the program regularly. Because some students in the program 
received a perfect score on the pretest, no posttest results were reported. 

In Table 6 . reasons for incomplete data are compared to the pro- 
portion of students who reviewed counseling. Except for truants, 
students for whom there was complete data were more likely to receive 
counseling than the students with any other reason for missing data. 

The comparison of receipt of counseling with rate of success in the 
program indicated in Table 7 demonstrates that students were more likely 
to meet the evaluation objective if they received counseling. 

In Table 8 . data about the program in schools visited by evaluation 
consultants are summarized. This summary indicates that the results 
from these schools are fairly representative of the entire program. 
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TABLE 1 

Statistical Summary of the Program in the Fall 





Beginning 

1 pupl 


Intermediate 
Level 


Advanced 
Level 


Total 


School s reported: 


35 


36 


36 


36 


Students reported*: 
Ninth grade: 
Tenth grade: 
El eventh grade: 
Twelfth grade: 


2,160 
1,125 
831 
176 
28 


2,009 
578 

1,033 
311 
87 


1,579 
227 
575 
553 
224 


7,017 
2,460 
2,881 
1,265 
410 


Proportion of students 
who met the evaluation 


45.1% 


37.5% 


8.6% 


25.6% 


Average number of skills 
mastered : 


6.18(q^ 


25) ^-^^(of 


25) 2.6^of 15)3-98 


Skills mastered as a percent 
of skills attempted: 


49.9% 


57.5% 


58.6% 


55.0% 


Proportion of students who 
received counseling: 


15.0% 


16.8% 


15.6% 


15.1% 


Average attendance (in days) 


: 59.8 


60.7 


61.4 


56.7 


(*) No skills were reported for 1,269 students. All the breakdowns by 
level in the statistical analysis of the fall data exclude these 
students However, the column labeled "Total" does include them. 
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TABLE 2 

Statistical Summary of the Program in the Spring 



Beginning Intermediate Advanced 



Level 



Level 



Schools reported: 

Students reported*: 
Ninth grade: 
Tenth grade: 
Eleventh grade: 
Twelfth grade: 

Proportion of students 
who met the evaluation 
objective: 

Average number of skills 
mastered: 

Skills mastered as a percent 
of skills attempted: 

Proportion of students who 
received counseling: 

Average attendance (in days): 



35 

1,967 
1,036 
771 
138 
22 



42.3%. 



36 

2,071 
575 

1,108 
315 
73 



36.0% 



Level 
36 

2,236 
450 

1,031 
548 
207 



13.6% 



Total 



5-71(of 25) ^•°^(of 25) ^-^^(of 15) 



37 

6,274 
2,061 
2,910 
1,001 
302 



25.1% 
3.74 



53.5% 

20.3% 
59.0 



56.8% 

20.7% 
60.0 



60.3% 

16.5% 
59.9 



57.3% 

17.7% 
59.6 



(*) No skills were reported for 1,113 students. However, all the 

breakdowns by level in the statistical analysis of the spring data 
include these students. 
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Proportion of Students Who Met the Crit erion of Success of the Evaluation 

Viective Bro ken Down by Their Attenda n ce in the program 

— During the Fal I 



Attendance 
\ In uaysj 

10 or Fewer 


Number of 


No 
Skills 
Reported 
X # 


EVALUATION OBJECTIVE 
Not Met Met 
% * % * 


321 


82.2/2g*\ 


^♦^(23) 


10.6^ 


11 - 20 


201 


71.6^144) 


®-^(17) 


^^•^(40) 


21 - 30 


225 


^•^(130) 


18.2^21) 


2*'0(54) 


31 - 40 


386 


*2-7(i65) 


^^•^(123) 


25.4^ggj 


41 - 50 


819 


1^-^(160) 


^^•^(445) 


26.1(214) 


51 - 60 


2,676 


^•2(246) 


^*-^(l,725) 


^^•^(705) 


61 or more 


2,389 


^•^(160) 


"•^(1,511) 


^°-^(718) 



TOTAL 7.017 ' 18-l(i,269) "-^O.SSS) "-'(LSeS) 
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TABLE 4 



Proportio n of Students Who Met the Criterion of Success of th e Evaluation 
— Objective Broken bom by Their Attendance in tne Program 
— During the Spring 



■ 




No 










Skills 


EVALUATION OBJECTIVE 


Attendance 


Number of 


Reported 


Not Met 


Met 


( in days) 


of Students 


% # 


% # 


X # 


10 or Fewer 


235 


80.0^87) 


^^•^(38) 


3*^10) 


11 - 20 


IOC 

lob 


fin ^ 


4.8^9j 


^^•5(28) 


21 - 30 


206 


60-6(124) • 


18.9^39j 


20-^43) 


31 - 40 


335 


3(133) 


3*-^117) 


2^-8(85) 




780 


(128) 


55.3^432) 


27.3^220) 


51 - 60 


2.524 


^°-^(233) 


^^•^(1.582) 


26-8(709) 


61 or more 


1.679 


^•^(159) 


^'*-^( 1.087) 


25-8(433) 


TOTAL 


5.945 


^^•^(1.113) 


^^•?(3.204) 


2^-^1.528) 
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Attendance 
(in days) 

10 or Fewer 

11 - 20 
21 - 30 
31 - 40 
41 - 50 
51-60 

61 or more 

TOTAL 



Attendance 
(In days) 

10 or Fewer 

-11 - 20 

21 - 30 

.31 - 40 

41 - 50 

51 - 60 

61 - 70 

TOTAL 




COMPLETE 
DATA 

Reported 

15-0(48) 

22.^45) 
40.4(9ij 

55.2(213) 

79-9(654) 

91-0(2434) 

93.6(2247) 



81.5 



(5732) 



COt^PLETE 
DATA 

Reported 
22.1(52) 

19-9(37) 
39.8(32) 

59-7(200) 
8^-7(661) 
91-8(2316) 
91-7(1540) 



82.2 



f4888) 



8-5(17) ^^-^(80) 

11.1(25) 32.0(72) 11-1(25) 1-3(3) 

15-8(61) 16-8(65) 7.3(28) 2.1(8) 

10.0(82) ^-0(33) 2.8(23) 0.7(gj 

^•0(108) °-6(17) °-^(18) °-3(7) 

0.8(20) 0.3(8) 0.8(^8) °-^9) 

^•8(376) 5.9(417) 3.3(23o) 1-0(68) 
Spring 

I N COMPLETE DATA 



1.6 
0.5 
0.5 
0.4 



(6) 
(4) 
(14) 
(10) 



1.3 
1.8 
2.9 
3.6 



(5) 
(15) 
(77) 
(87) 



0.7 



(50) 



2.7 



(191) 



Absent for 
Test 



9.4 
13.4 
16.5 
16.4 



(22) 
(25) 
(34) 
(55) 



7.4 
3.2 
1.0 



(58) 
(82) 
(17) 



Truant 

32-3(76) 
39-8(74) 
25-7(53) 

1^-^45) 

2-1(16) 
0.2(5) 

0-7(12) 



Discharged 

26-4(62) 
20.4 

12.1 

6.9 

2.2 

0.3 

1.3 



Transferred Perfect Score 

Out Other on Pretest 



(38) 
(25) 
(23) 
(17) 
(7) 
(22) 



8.1 
1.6 
2.4 

0.9/ 



(19) 
(3) 
(5) 



0.9 
3.2 
1.5 



(2) 
(6) 



'(3) 

0-0(0) 
0.1 

0.3 



(2) 
(5) 



1.2 
0.6 
0.7 



(3) 
(4) 
(5) 



0.8 



(18) 
(14) 



0.4 
0.5 
1.9 
1.5 
2.8 
3.6 
4.1 



(1) 
(1) 



(4) 

(5) 

(22) 

(92) 

(68) 



4.9 



(293) 



4.7 



(281) 



3.3 



(194) 



0.6 



(37) 



0.9 



(52) 



3.2 



(193) 
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TABLE 6 

prnnnrti on of Studeots Who Received Couns eling Broken Down by Reason 
— ^ for Incomplete Test nesults 





FALL 






COUNSELING 






Received 


Reasons 


X # 


X # 


None 


^ (4799) 




Absent for test 


^2-6 ( 311) 


( 25) 


Truant 


^•^ ( 353) 


15.3 ^ g4) 


D1 scharged 


( 209) 


( 21) 


Transferred out 


57-1 ( 66) 


2.9 ( 2) 


Other 


82.0 ( 


18.0 ( 9) 


Perfect score on oretest 


52-1 ( 176) 


( 15) 


■ 




TOTAL (7^017) 








None 


(3942) 


(946) 


Absent for test 


93.5 ( 274) 


6.5 ( 19) 


Truant 


80.8 / 227) 


( 54) 


01 scharged 


90.2 ( 175) 


( 19) 


Transferred out 


86.5 ^ 32) 


13.5 ^ 5) 


Other 


88.5 ( ^g) 


11-5 ( 6) 


Perfect score on pretest 


57-* ( 188) 


2.6 ( 5) 






TOTAL (5,945) 
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TABLE 7 



Prnnor tion of Students Who Met the Evaluation Objective Acc ording to 
— ^ Whether They Receiveo counseling 



Counseling 



FALL 



EVALUATION OBJECTIVE 
Not Met Met 
% # % # 



Not Received 
Received 



^^•^ (4416) (1541) 
fi^-fi ( 738) ^^-^ ( 322) 



TOTAL (7,017) 



Not Received 
Received 



SPRING 



^^'^ (3732) (1157) 
55-1 ( 730) ^^'^ ( 326) 



TOTAL (5,945) 
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TABLE 8 

Statistical Summary of Selected Schools* 



Site A B c u t 
Students Reported: 

Beginning Level 75 125 200 225 40 

Intermediate Level 50 110 225 225 60 

Advanced Level 25 225 125 200 60 

Proportion of Students who 

met the evaluation objective: ZS.0% 20,0% 35.0% 25.0% 25.0% 

Average number of ^ * « « « 

skills mastered: 3.0 3.0 5.0 4.0 4.0 

Number of skills mastered as 
a percent of number of skills 

attempted: 60.0% 70. 0« 50. 0« 55. 0« 60.0% 
Proportion of students 

who received counseling ^ ^ ^ ^ 

tin percent): 25.0 3.0 90.0 2.0 2.0 

Average attendance 

(in days): 50 60 60 60 60 



* This sunmary lists approximate results for both the fall and spring 
terms to demonstrate the exemplary/representative characteristics of 
the sites in which consultants conducted observations and interviews. 
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IV. Conclusions and Recommendations 

The program benefits from a high degree of cooperation among all 
those Involved In Implementing the program . Aside from their regular 
visits, teacher trainers are available for specially requested workshops 
or general advice on matters of classroom teaching, testing and data 
collection. Excellent teaching materials are readily available from the 
central office. There Is also frequent, infomal communication between 
coordinators and teachers, among teachers, and between teachers and 
paraprofesslonals. Teachers work at all Instructional levels devising 
and sharing materials and demonstrating practical understanding of the 
.operation and alms of each level. Title I and tax^levy courses are also 
generally well-coordinated, and the administrative staffs of the schools 
as well as teachers In other programs, are supportive and sensitive to 
the goals of ESL classes. Apart from a tight curriculum In the program, 
this coordination with other programs is essential if the students are 
to be integrated into regular academic subjects. 

Since the purpose of this report has been to describe and evaluate 
the organizational characteristics of sites where the ESL program is 
being effectively implemented, as well as to detail general features of 
the program, the successful characteristics identified above should be 
replicated in other ESL schools. These features include curriculum 
flexibility and classroom atmosphere. 

The standardized elements of the ESL curriculum are based to a 
great extent on the CREST test. Individual student deficiencies, 
identified on the test, are directly linked to the CREST Objective 
Locator which serves as a syllabus for the program. However, because 
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1,200 student test results were not reported each term, it appears that 
the test is given infrequently, perhaps only as a pretest at the begin- 
ning of the term and as a posttest at the end. This practice produces 
two negative consequences: (1) skills mastered by students who are 
present for only part of the term cannot be reported; and (2) a more 
frequent use of the test might increase the average nunber of skills 
mastered anong those students with complete data reported. 

In spite of the operational success of the program, as discussed 
above, only about one-fourth of the students met the evaluation objec- . 
tive of the program which stated that a student should master one skill 
on the test for every ten days of instruction. 

A possible reason why students fall short of meeting the evaluation 
objective may be a problem inherent within the objective itself. The 
mastery criterion of one objective for every ten days of instruction is 
arbitrary and may not reflect realistic expectations for students in the 
program. Furthermore, given the difference in student performance at 
different levels of the program (beginning, intermediate and advanced), 
a single objective for all students in the program appears to be pro- 
blematic. As with the use of all criterion- referenced tests, it is 
important to set standards that are high enough for teachers and stu- 
dents to be motivated to reach these standards. But, in addition, these 
standards should not be so high that it is impossible for most students 
to achieve them. Indeed, they should be tied closely to the pattern of 
student advancement throughout the curriculum, in order to reflect 
realistic expectations for the student population within the program. 
For this to occur, it is necessary that longitudinal data be collected 

2S 



- 24 - 



to document the progress of students in the program. Oily after this 
data is collected can realistic standards be set. In addition, in 
setting these standards of performance, student progress should be 
compared and equated to student performance on standardized instrunents: 

The evaluators have observed the ESL program and reviewed possible 
reasons for the discrepancies between the successful operation of the 
program and the comparatively low nunber of studerits v*io met the eval- 
uation objective. It appears that the performance standard on the CREST 
stated in the evaluation objective is unrealistic. The fact that stu- 
dent outcone data does not meet the evaluation objective appears to be 
an artifact of the objective, not an indication. of lack of student 
learning or poor student performance. Therefore, the following specific 
recommendations are made; 

1. Progress of students at each level of the ESL Program should be 
maintained longitudinally. These data should be used for estab- 
blishing realistic standards for student advancement within the 
program and for performance on the CREST. 

2. An equating study should be performed in which students are tested 
using both the CREST and a standardized instrument. This will 
provide further data for establishing realistic criteria for stu- 
dent performance on the CREST. 

3. The CREST should be given as students master specific skill areas, 
not only as a pretest and posttest. This will eliminate data loss 
for students who are not present for an entire term. Furthermore, 
it will give teachers an opportunity to assess the progress of 
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their students mora frequently and may increase the chance that 
students have to achieve skill mastery. 

4. A separate perfomance objective should be established for students 
at each level (beginning, intennediate and advanced) of the ESL 
program. The objective should reflect the difficulty of the 
curriculum at each level and the number of skills being taught at 
each level . 
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